IMAGE PROCESSOR 



BACKGROUND OF THE INVENTION 

The present invention relates to an image processor for 

5 capturing an image of an object and then recording image 
data, representing the image, on a storage medium. 

In capturing a series of still images {which operation 
will be herein referred to as "continuous shooting''), a known 
image processor compresses the image data representing the 

10 series of images captured and then stores the compressed data 
on an image memory. The processor once stores the compressed 
data on the image memory to capture those images at as short 
intervals as possible. On finishing the continuous shooting 
operation, the image processor starts to transfer the com- 

15 pressed data from the image memory to a storage medium. 

FIG. 7 is a block diagram illustrating a configuration 
for a known image processor of that type. As shown in FIG. 7, 
the processor includes imager 91, compressor/expander 92, im- 
age memory 93, memory interface (I/F) 94, display memory 95, 

20 display 96, controller 97 and storage medium 98. In this 
processor, the image data, captured by an imaging device (not 
shown) included in the imager 91, is compressed by the com- 
pressor/expander 92 and the compressed data is output to, and 
once stored on, the image memory 93. Then, the image data that 

25 has been once stored on the image memory 93 is transferred to 
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the storage medium 98 by way of the memory I/F 94. This data 
flow is indicated by "A" in FIG. 7. While the data is being 
transferred to the storage medium 98, the display 96 can oper- 
ate in monitor display mode, freeze display mode or blackout 
5 display mode. 

In the monitor display mode, the image to be monitored, 
which has been output from the imager 91 and just arrived at 
the display 96, is presented as it is on the display 96. This 
data flow is indicated by ''C" in FIG. 7. In the freeze dis- 

10 play mode on the other hand, the image data, which is left on 
the image memory 95, is presented on the display 96. This da- 
ta flow is indicated by "D'' in FIG. 7. In the blackout dis- 
play mode, the data that has been provided from the display 
memory 95 is replaced with data representing the color black 

15 and then the blackout data is presented on the display 96.. 
This data flow is also indicated by "D" in FIG. 7. 

Where consecutive shots should be reviewed, reproduction 
processing is started after the image data has been trans- 
ferred to the storage medium 98 completely. That is to say, 

20 the image data should be read out from the storage medium 98 
and then decompressed by the compressor /expander 92 before the 
decompressed data is presented on the display 96. This data 
flow is indicated by ''E'" in FIG. 7. In this processor, the 
overall data transfer is under the control of the controlle^r 

25 97. 
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In capturing only one image (which operation will be 
herein referred to as "single shooting"), it takes just a 
short time for the image processor to transfer the captured 
image data to the storage medium completely. Accordingly, the 
5 time for getting the image processor ready for the next photo- 
graphing operation is too short to irritate the user. After a 
series of images have been captured consecutively, however, 
multiple frames of image data should be once stored on the im- 
age memory and then transferred to the storage medium one af- 
10 ter another. Thus, the user has to wait a much longer time 
until the transfer is complete, i.e., before he or she can re- 
view the images photographed or can start the next photograph- 
ing operation. 

As can be seen, when using the known image processor, the 
15 user has to wait a long time before he or she can review his 
or her consecutive shots. This is because the image processor 
should once record the image data on the storage medium and 
then read out and present the data once stored. 

Recently, as the number of imaging devices integrated has 
20 been increasing steeply, an even more enormous quantity of da- 
ta should be transferred from the image memory to the storages 
medium as for the continuous shooting. Accordingly, the user 
has to wait a longer and longer time before he or she can re- 
view his or her consecutive shots. 
25 Also, in the known image processor, a blackout image or a 



frozen still image is displayed while the image data is being 
transferred to the storage medium. This is a bore for almost 
all users. In addition, even if the display is operated in 
the monitor display mode, additional power is needed for driv- 
5 ing the imager. 

SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to 
provide an image processor allowing the user to review his/her 

10 consecutive shots instantaneously, or without making him or 
her wait a long time until the image data, representing those 
shots, has been transferred to the storage medium completely. 

An image processor according to the present invention is 
for use to capture an image of an object and record image 

15 data, representing the image, on a storage medium. While im- 
age data, representing a series of images captured consecu- 
tively, is being transferred to the storage medium, the image 
processor presents the series of images sequentially in an 
order in which the images have been captured. 

20 According to the present invention, the user can review 

his or her consecutive shots instantaneously without waiting 
until the image data, representing his or her shots, has been 
transferred to the storage medium completely. Thus, while the 
image data is being transferred, the user can determine wheth- 

25 er or not the transfer of the image data should be stopped. 



Another image processor according to the present inven- 
tion includes imager, compressor /expander , image memory, dis- 
play memory, display and interface. The imager captures an 
image of an object and outputs image data, representing the 

5 image captured, to the compressor/expander • The compres- 
sor/expander either compresses the image data and then out- 
puts the compressed image data to the image memory or 
receives and expands the compressed image data and then out- 
puts the expanded image data to the display memory. The ex- 

10 panded image data, stored on the display memory, is then 
presented on the display, while the compressed image data, 
once stored on the image memory, is then recorded by the in- 
terface on a storage medium. In this processor, if the im- 
ager has captured a series of images consecutively, the image 

15 memory stores thereon compressed image data representing the 
images. On the other hand, the compressor/expander expands 
the compressed image data, representing those images, and 
then outputs the expanded image data to the display memory so 
that the images are presented on the display sequentially in 

20 an order in which the images have been captured, while the 
compressed image data, representing the images, is being 
transferred from the image memory to the storage medium. 

According to the present invention, the user can review 
his or her consecutive shots instantaneously by reference to 

25 the image data being transferred to the storage medium, i.e.. 
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without waiting until the image data, representing those 
shots, has been transferred to the storage medium completely. 
Thus, while the image data is being transferred, the user can 
determine whether or not the transfer of the image data should 

5 be stopped. In addition, the user can also check any change 
occurring in the images by comparing one of the consecutive 
shots to preceding and succeeding ones of the shots. 

In one embodiment of the present invention, the compres- 
sor/expander may produce a reduced-size image for each said 

10 image captured and compress the reduced-size image to obtain 
and output the compressed image data* The compressor/expander 
may also expand the compressed image data, representing the 
series of images, and then output the expanded image data to 
the display memory so that the reduced-size versions of the 

15 series of images can be presented one by one on the same dis- 
play in the order in which the images have been captured. 
Then, multiple images of a reduced size can be presented one 
by one on the same display screen. Accordingly, the user can 
easily check any change occurring in the images by comparing 

20 one of his or her consecutive shots to preceding and succeed- 
ing ones of the shots . 

In another embodiment, the compressor/expander may ex- 
pand the compressed image data, representing each of the seri- 
es of images which is being transferred to the storage medium, 

25 and then output the expanded image data to the display memory 
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so that each said image being transferred can be presented on 
the display* In such an embodiment, each image being trans- 
ferred can be presented on the display one after another and 
the user can see how much image data has been transferred so 
5 far. 



BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram illustrating a configuration 
for an image processor according to an embodiment of the pre- 
10 sent invention . 

FIG, 2 illustrates the contents stored on the image 
memory shown in FIG. 1* 

FIG. 3 is a timing diagram illustrating how the proces- 
sor shown in FIG. 1 may operate when presenting thumbnail im- 
15 ages . 

FIG. 4 illustrates how thumbnail images are presented 
one by one on the display shown in FIG. 1. 

FIG. 5 is a timing diagram illustrating how the proces- 
sor shown in FIG. 1 may operate when presenting full-size im- 
20 ages . 

FIG. 6 illustrates how full-size images are presented 
one after another on the display shown in FIG. 1. 

FIG. 7 is a block diagram illustrating a configuration 
for a known image processor. 

25 
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DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Hereinafter, preferred embodiments of the present inven- 
tion will be described with reference to the accompanying 
drawings . 

5 FIG, 1 is a block diagram illustrating a configuration 

for an image processor according to an embodiment of the pre- 
sent invention. The processor shown in FIG. 1 includes 
imager 1, compressor/expander 2, image memory 3, memory in- 
terface (I/F) 4, display memory 5, display 6 and controller 
10 7. In FIG. 1;. the dashed lines indicate two possible data 
flows A and B. 

The imager 1 includes solid-state imaging devices like 
charge-coupled devices (CCDs) and generates a video signal 
representing an image captured. Then, the imager 1 converts 

15 the video signal into luminance and chrominance signal data 
and then outputs the data to the compressor/expander 2. An 
image as represented by the luminance and chrominance signal 
data will be herein referred to as a ''full-size image''. 

The compressor/expander 2 decimates pixels from the full- 

20 size image output from the imager 1, thereby producing a re- 
duced-size image (which will be herein referred to as a 
"thumbnail image"). The compressor/expander 2 compresses the 
full-size or thumbnail image in compliance with the JPEG 
(joint photographic image coding experts group) standard and 

25 then outputs the resultant compressed image data to the image 



memory 3. Or the compress or/ expander 2 reads out the com- 
pressed image data from the image memory 3, expands the image 
data to obtain a full-size or thumbnail image and then outputs 
the image to the display memory 5. 
5 The image memory 3 temporarily stores thereon the com- 

pressed image data of a full-size image (which will be herein 
referred to as "full-size compressed image data'') and the 
compressed image data of a thumbnail image (which will be 
herein referred to as "thumbnail compressed image data"). 
10 Then;, the image memory 3 writes or reads the compressed image 
data on/ from a storage medium 8 by way of the memory inter- 
face 4. 

Any type of storage medium that can retain image data 
thereon may be used as the storage medium 8. Examples of the 

15 storage media include semiconductor memories, magnetic record- 
ing media and optical disks. The storage medium 8 may be ei- 
ther removable or fixed. In the illustrated embodiment, the 
storage medium 8 is supposed to be a compact flash card in- 
cluding flash memories. The storage medium 8 may also be a 

20 smart medium or a super disk, for example. 

The memory interface 4 converts the compressed image da- 
ta into a version adaptable to the storage medium 8 and then 
writes the converted data on the storage medium 8. Or the 
memory interface 4 reads out data from the medium 8, converts 

25 the data to obtain compressed image data and then outputs the 
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image data to the image memory 3. For example^ where a disk 
is used as the medium 8, the memory interface 4 may be re- 
placed with a disk drive (not shown) suitable for the disk. 

The display memory 5 operates as a display buffer mem- 
5 ory. Specifically, the display memory 5 stores the image, 
which has been expanded and output by the compressor/expander 
2, and then outputs the image to the display 6. In response, 
the display 6 presents the image stored on the display memory 

10 The controller 7 controls the operations of the imager 

1, compressor /expander 2, image memory 3 and display memory 
5. Specifically, when an appropriate instruction is given to 
the controller 7, the compressor/expander 2 can selectively 
read out the compressed image data representing a full-size 

15 or thumbnail image from the image memory 3 , expand the com- 
pressed image data and then get the decompressed image pre- 
sented on the display 6. 

Next, it will be described how the processor shown in 
FIG. 1 operates during and after continuous shooting. 

20 Where the processor processes a series of images con- 

secutively, the compressor/expander 2 may produce thumbnail 
images from the output data of the imager 1, which represents 
full-size images, at regular intervals, compress these images 
and then output the compressed image data to the image memory 

25 3 . 



FIG. 2 illustrates the contents stored on the image mem- 
ory 3. If the imager 1 has captured a number n (which is an 
integer equal to or greater than two) of images consecu- 
tively, the image memory 3 stores first through n^^ pairs of 
5 full-size and thumbnail compressed image data CFUl and CTHl 
through CFUn and CTHn as shown in FIG. 2. 

The image memory 3 outputs the full-size compressed im- 
age data CFUl through CFUn and the thumbnail compressed image 
data CTHl through CTHn to the memory interface 4. However, 

10 the image memory 3 selectively outputs either the full-size 
compressed image data CFUl through CFUn or the thumbnail com- 
pressed image data CTHl through CTHn to the compres- 
sor/expander 2 in accordance with the type of the images to 
be presented on the display 6. 

15 FIG. 3 is a timing diagram illustrating how the proces- 

sor shown in FIG. 1 may operate when presenting thumbnail im- 
ages. FIG. 4 illustrates how the thumbnail images are 
presented one by one on the display 6. 

As shown in FIG. 3, in the interval T31 just after the 

20 images have been captured consecutively, the compres- 
sor/expander 2 reads out only the thumbnail compressed image 
data CTHl of the first image from the image memory 3 , expands 
the image data CTHl to obtain a thumbnail image THl and then 
outputs the image THl to the display memory 5 . This data flow 

25 is indicated by "B" in FIG. 1. 



In the next interval T32, the image memory 3 transfers 
the full-size and thumbnail compressed image data CFUl and 
CTHl of the first image to the storage medium 8 by way of the 
memory interface 4. As a result, these two types of data are 
5 written as a file Fl on the storage medium 8* This data flow 
is indicated by "A" in FIG. 1. In the meantime, the display 6 
presents the thumbnail image THl of the first image that has 
been stored on the display memory 5 as shown in FIG. 4A. This 
data flow is indicated by ''B'' in FIG. 1. That is to say, the 

10 image being transferred to the storage medium 8 is presented 
on the display 6. 

In the next interval T33, the same thumbnail image THl 
is still presented on the display 6. In this same interval, 
the compressor/expander 2 reads out only the thumbnail com- 

15 pressed image data CTH2 of the second image from the image 
memory 3,. expands the image data CTH2 to obtain a thumbnail 
image TH2 and then outputs the image TH2 to the display memory 
5. In this case, the controller 7 controls the addresses of 
the images THl and TH2 on the display memory 5 so that the 

20 thumbnail image TH2 does not overlap with, but is displayed 
next to, the thumbnail image THl. 

In the next interval T34, the image memory 3 transfers 
the full-size and thumbnail compressed image data CFU2 and 
CTH2 of the second image to the storage medium 8 by way of 

25 the memory interface 4. As a result, these two types of data 
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are written as a file F2 on the storage medium 8. In the 
meantime, the display 6 presents, side by side, the thumbnail 
images THl and TH2 of the first and second images stored on 
the image memory 5 as shown in FIG. 4B. 

5 In the same way, after the thumbnail image TH3 of the 

third image has been output to the display memory 5 in the 
interval T35, the compressed image data of the third image is 
transferred from the image memory 3 to the storage medium 8 
and written as a file F3 on the medium 8 in the interval T36. 

10 In this interval T36, the thumbnail images THl through TH3 
are presented on the display 6 as shown in FIG. 4C. These 
operations will be repeatedly performed until the compressed 
image data of the n^^ image has been written on the medium 8. 

In this manner, according to the present invention, com- 

15 pressed image data is expanded first, and then the expanded 
data is presented on the display 6 while the same compressed 
image data is being transferred to the medium 8. In contrast, 
the known image processor such as that shown in FIG. 7 has to 
conduct the blackout or freeze display (e.g., the n""^ image is 

20 presented continuously) while the compressed image data is be- 
ing transferred to the storage medium- 

The thumbnail images sequentially appear, and are added 
one by one, onto the same screen in the order in which their 
original images were captured. For example, while the com- 

25 pressed image data of the ninth image is being transferred. 
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the thumbnail images THl through TH9 of the first through nin- 
th images are displayed on the same screen as shown in FIG. 
4D. 

As described above, according to the present invention, 
5 while the image data representing a series of images captured 
consecutively is being transferred to a medium, the thumbnail 
images thereof are sequentially displayed one by one. Thus, 
the user can review the images without waiting until the image 
data representing his or her consecutive shots has been trans- 
10 f erred completely. Also, since the image being transferred to 
the medium is displayed, the user can know how much data has 
been transferred so far. Furthermore, the thumbnail images 
may be displayed side by side as shown in FIG. 4 in the order 
in which their original images were captured. Accordingly, 
15 the user can easily check any change occurring in the images 
by comparing one of his or her consecutive shots to the 
preceding and succeeding ones of them. 

In the example illustrated in FIG. 4, the nine thumbnail 
images THl through TH9 are displayed on one screen. However, 
20 any other number of thumbnail images may be displayed on one 
screen. If the number n of images captured consecutively is 
greater than the preset nuit±>er m (where m is an integer equal 
to or greater than two) of thumbnail images that can be dis- 
played on one screen at a time, then the number m may be in- 
25 creased. Alternatively, the entire screen may be cleared once 
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and then the remaining thumbnail images may be sequentially 
displayed one by one from the (m+1)^^ image. 

Next, it will be described how the processor shown in 
FIG. 1 operates when presenting non-reduced, full-size images, 
5 not the thumbnail images . 

FIG. 5 is a timing diagram illustrating how the proces- 
sor shown in FIG. 1 may operate when presenting full-size im- 
ages. FIG. 6 illustrates how the full-size images are 
presented one after another on the display 6. 

10 As shown in FIG. 5, in the interval T51 just after the 

images have been captured consecutively, the compres- 
sor/expander 2 reads out only the full-size compressed image 
data CFUl of the first image from the image memory 3, expands 
the image data CFUl to obtain a full-size image FUl and then 

15 outputs the image FUl to the display memory 5. 

In the next interval T52 , the image memory 3 transfers 
the full-size and thumbnail compressed image data CFUl and 
CTHl of the first image to the storage medium 8 by way of the 
memory interface 4. As a result, these two types of data are 

20 written as a file FX on the storage medium 8. In the mean- 
time, the display 6 presents the full-size image FUl of the 
first image stored on the image memory 5 as shown in FIG. 6A. 
That is to say, the image being transferred to the storage me- 
dium 8 is presented on the display 6. 

25 In the next interval T53, the same full-size image FUl 
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is still presented on the display 6. In this same interval, 
the compressor /expander 2 reads out only the full-size com- 
pressed image data CFU2 of the second image from the image 
memory 3, expands the image data CFU2 to obtain a full-size 
5 image FU2 and then outputs the image FU2 to the display memory 
5. In this case, the controller 7 controls the addresses of 
the images FUl and FU2 on the display memory 5 so that the 
full-size image FU2 is displayed instead of the full-size im- 
age FUl. 

10 In the next interval T54, the image memory 3 transfers 

the full-size and thumbnail compressed image data CFU2 and 
CTH2 of the second image to the storage medium 8 by way of 
the memory interface 4. As a result, these two types of data 
are written as a file F2 on the storage medium 8. In the 

15 meantime, the display 6 presents the full-size image FU2 of 
the second image stored on the image memory 5 as shown in FIG. 
6B. 

In the same way, after the full-size image FU3 of the 
third image has been output to the display memory 5 in the 

20 interval T55, the compressed image data of the third image is 
transferred from the image memory 3 to the storage medium 8 
and written as a file F3 on the medium 8 in the interval T56, 
In this interval T56, the full-size image FU3 is presented on 
the display 6 as shown in FIG. 6C. These operations will be 

25 repeatedly performed until the compressed image data of the n^^ 
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image has been written on the medium 8. 

In this manner, the full-size images are displayed one 
after another in the order in which the images were captured. 
For example, while the compressed image data of the ninth im- 
5 age is being transferred, the full-size image FU9 of the ninth 
image is displayed as shown in FIG. 6D. 

As described above, while the image data, representing a 
series of images captured consecutively, is being transferred 
to the storage medium, the full-size images thereof may be 

10 displayed one after another according to the present inven- 
tion. Even in this situation, the user can also review the 
linages without waiting until the image data representing his 
or her consecutive shots has been transferred completely. 
Also, since the image being transferred to the medium is dis- 

15 played, the user can also know how much data has been trans- 
ferred so far. Furthermore, the images are displayed one 
after another in the order in which the images were captured. 
Accordingly, the user can easily check any change occurring in 
the images by comparing one of his or her consecutive shots to 

20 the preceding and succeeding ones of them. 

If the user has photographed a series of images of an 
object with little motion, then it might be difficult for him 
or her to perceive the change using their thumbnail versions 
only. In that case, it would be easier for him or her to 

25 check the change if the full-size images are displayed one 
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after another as in the example illustrated in FIGS. 5 and 6. 

In the image processor shown in FIG. 1, the image and 
display memories 3 and 5 are provided separately. Alterna- 
tively, the image and display memories 3 and 5 are imple- 
5 mentable as a single memory. In that case, the image data to 
be temporarily stored on the image memory 3 and then trans- 
ferred to the storage medium 8 may coexist in the same memory 
area with the image data to be stored on the display memory 5 
and presented on the display 6. However, the processing would 

10 be easier if the memory area is divided into two blocks for 
the image data to be transferred and the image data to be dis- 
played , respectively . 

In the embodiment illustrated in FIG. 3, after the thumb- 
nail compressed image data CTHl has been expanded in the in- 

15 terval T31, the full-size and thumbnail compressed image data 
CFUl and CTHl is transferred to the storage medium 8 in the 
next interval T32. Alternatively, the expansion and the 
transfer may also be performed concurrently. Then, the over- 
all processing time can be shortened. 

20 Also, in the foregoing embodiment, while the image data 

of an image is being transferred to the medium, the same image 
is displayed. That is to say, the foregoing embodiment sup- 
poses that the display screen should be updated synchronously 
with the transfer of the image data to the medium* However, 

25 the screen does not have to be updated synchronously with the 
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data transfer. 

For example, the display update interval may be modified 
in such a manner as to allow the user to review the images 
more easily. As another alternative, the images may be dis- 
5 played at shorter intervals. That is to say, before the image 
data of an image is transferred to the medium, the image may 
be displayed. Then, just by taking a look at the screen 
briefly, the user can determine whether or not the image data 
should be saved. If the answer is NO, the user can readily 

10 cancel the transfer of his or her unwanted data to the medium 
at once. Accordingly, no unwanted data is transferred and the 
time for the transfer processing can be shortened as a whole. 

As another alternative, before the image data of a series 
of images captured consecutively starts to be transferred to 

15 the medium, these images may start to be displayed. In that 
case, all of those images may be displayed before the image 
data has been transferred to the medium completely. 

As described above, according to the present invention, 
after a series of images have been captured consecutively and 

20 before the image data representing the images has been trans- 
ferred to the storage medium completely, those images are dis- 
played. Thus, the user can review his or her consecutive 
shots without having to wait a long time. In addition, ac- 
cording to the present invention, no freeze display or no 

25 monitor display of the imager output is conducted during the 
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image data transfer. Consequently, the present invention 
eliminates the need of operating the display or the imager in 
vain and cuts down the power dissipation. 
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